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Abstract Finite frames can be viewed as mass points distributed in A^-dimensional 
Euclidean space. As such they form a subclass of a larger and rich class of proba- 
bility measures that we call probabilistic frames. We derive the basic properties of 
probabilistic frames, and we characterize one of their subclasses in terms of min- 
imizers of some appropriate potential function. In addition, we survey a range of 
areas where probabilistic frames, albeit, under different names, appear. These ar- 
eas include directional statistics, the geometry of convex bodies, and the theory of 
t-designs. 



1 Introduction 

Finite frames in are spanning sets that allow the analysis and synthesis of vectors 
in a way similar to basis decompositions. However, frames are redundant systems 
and as such the reconstruction formula they provide is not unique. This redundancy 
plays a key role in many applications of frames which appear now in a range of areas 
that include, but is not limited to, signal processing, quantum computing, coding 
theory, and sparse representations, cf. ll9l l20ll2TI for an overview. 

By viewing the frame vectors as discrete mass distributions on Mr, one can ex- 
tend frame concepts to probability measures. This point of view was developed in 
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T\M under the name of probabilistic frames and was further expanded in [1611 . The 
goal of this chapter is to summarize the main properties of probabilistic frames and 
to bring forth their relationship to other areas of mathematics. 

The richness of the set of probability measures together with the availability of 
analytic and algebraic tools, make it straightforward to construct many examples 
of probabilistic frames. For instance, by convolving probability measures, we have 
been able to generate new probabilistic frames from existing ones. In addition, the 
probabilistic framework considered in this chapter, allows us to introduce a new 
distance on frames, namely the Wasserstein distance 0311 . also known as the Earth 
Mover's distance ll23l . Unlike standard frame distances in the literature such as the 
^-distance, the Wasserstein metric enables us to define a meaningful distance be- 
tween two frames of different cardinalities. 

As we shall see later in Section|4] probabilistic frames are also tightly related to 
various notions that appeared in areas such as the theory of f-designs j!13], Positive 
Operator- Valued Measures (POVM) encountered in quantum computing lffl [TTl[T2l . 
and isometric measures used in the study of convex bodies [17, 1 8 ] 26] . In particular, 
in 1948, F. John ifTHl gave a characterization of what is known today as unit norm 
tight frames in terms of an ellipsoid of maximal volume, called John's ellipsoid. The 
latter and other ellipsoids in some extremal positions, are supports of probability 
measures that turn out to be probabilistic frames. The connections between frames 
and convex bodies could offer new insight to the construction of frames, on which 
we plan to elaborate elsewhere. 

Finally, it is worth mentioning the connections between probabilistic frames and 
statistics. For instance, in directional statistics probabilistic tight frames can be used 
to measure inconsistencies of certain statistical tests. Moreover, in the setting of M- 
estimators as discussed in |fT9ll29l[30l . finite tight frames can be derived from max- 
imum likelihood estimators that are used for parameter estimation of probabilistic 
frames. 

This chapter is organized as follows. In Section|2]we define probabilistic frames, 
prove some of their main properties, and give a few examples. In Section|3]we in- 
troduce the notion of the probabilistic frame potential and characterize its minima 
in terms of tight probabilistic frames. In Section |4] we discuss the relationship be- 
tween probabilistic frames and other areas such as the geometry of convex bodies, 
quantum computing, the theory of f-designs, directional statistics, and compressed 
sensing. 



2 Probabilistic Frames 

2.1 Definition and basic properties 

Let & := ^ 2 (^,R Af ) denote the collection of probability measures on M. N with 
respect to the Borel <7-algebra SB, Recall that the support of jj, £ 3* is 
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supp(ju) = {x <G : fi(U x ) > 0, for all open subsets x eU x cR N }. 

We write £P(K) := 3P{38,lC) for those probability measures in 3? whose support 
is contained in K C M. N . The linear span of supp(/x) in M N is denoted by En. 

Definition 1. A Borel probability measure ji e is a probabilistic frame if there 
exists < A < B < °° such that 

A||x|| 2 < / \(x,y)\ 2 dn(y) <B|U|| 2 , for all x g M N . (1) 

Jm N 

The constants A and B are called lower and upper probabilistic frame bounds, re- 
spectively. When A = B, jj. is called a tight probabilistic frame. If only the upper 
inequality holds, then we call jj. a Bessel probability measure. 

This notion was introduced in [|T4| and was further developed in |[T6l . We shall 
see later in Section 12.21 that probabilistic frames provide reconstruction formulas 
similar to those known from finite frames. Moreover, tight probabilistic frames are 
present in many areas including convex bodies, mathematical physics, and statis- 
tics, cf. Section |4] We begin by giving a complete characterization of probabilistic 
frames, for which we first need some preliminary definitions. 

Let 

^ 2 := ^i{M N ) = |m e & : M\{\i) := \\x\\ 2 d^i (x) < °° J (2) 

be the (convex) set of all probability measure with finite second moments. There 
exists a natural metric on called the 2-Wasserstein metric and given by 

W 2 2 (M,v):=min{ f \\x - y\\ 2 d 7 (x,y), 7 e r(^i,v)} , (3) 

where v) is the set of all Borel probability measures y on Mr x M. N whose 
marginals are and v, respectively, i.e., y(A x R N ) = /j(A) and y(R N x B) = v(B) 
for all Borel subset A, B in R. The Wasserstein distance represents the "work" 
that is needed to transfer the mass from jj. into v, and each y £ r(jj.,v) is called a 
transport plan. We refer to J2J Chapter 7], OTl Chapter 6] for more details on the 
Wasserstein spaces. 

Theorem 1. A Borel probability measure ji £ 8? is a probabilistic frame if and only 
if pi & 3^2 and = Mr. Moreover, ifjl is a tight probabilistic frame, then the frame 
bound A is given by A = ^Mf (^i) = i J m n \\y\\ 2 dniy). 

Proof. Assume first that fi is a probabilistic frame, and let {(pi}f =1 be an orthonor- 
mal basis for R N . By letting x = q)j in ([]]), we have A < f Rjv \ ((pi,y)\ 2 dn(y) < B. 
Summing these inequalities over i leads to A < ^ J r n \\y\\ 2 djJ.(y) < B < °°, which 
proves that jj. € 3?2- Note that the latter inequalities also prove the second part of 
the theorem. 
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To prove = M. N , we assume that ^ {0} and choose 0^i€ E^. The left 
hand side of (Q~|i then yields a contradiction. 

For the reverse implication, let Mi (jit) < °° and £^ = R . The upper bound in ([Tji 
is obtained by a simple application of the Cauchy-Schwartz inequality with B = 
Ir n lbl| 2 ^M(y)- To obtain the lower frame bound, let 



A:= inf 



Vl< ?i'/ M(y) )= inf^/j^l^W). 

Due to the dominated convergence theorem, the mapping x i— ► J K w |(x,y)| 2 £//i(y) 
is continuous and the infimum is in fact a minimum since the unit sphere S N ~ 1 is 
compact. Let xq be in S N ~ such that 

i K«o > y)l 2 rfM(y)- 

We need to verify that A > 0: Since £^ = M. N , there is yo € supp(/i) such that 
|(xo,yo)| 2 > 0. Therefore, there is e > and an open subset U yo C M. N satis- 
fying y G U ya and |(x,y)| 2 > £, for all y G I/ vo . Since lx(U yo ) > 0, we obtain 
A > e/i (I/yo) > 0' which concludes the proof of the first part of the proposition. 

Remark 1. A tight probabilistic frame ji with M2(fl) = 1 will be referred to as unit 
norm tight probabilistic frame. In this case the frame bound is A = jj which only de- 
pends on the dimension of the ambient space. In fact, any tight probabilistic frame jj. 
whose support is contained in the unit sphere S N ~ 1 is a unit norm tight probabilistic 
frame. 

In the sequel, the Dirac measure supported at <p G M. N is denoted by 8^. 

Proposition 1. Let <P = (<P;);=i be a sequence of nonzero vectors in Mr, and let 
be a sequence of positive numbers. 

a) <P is a frame with frame bounds < A < B < °° if and only if flip := Y4L1 <V, 
is a probabilistic frame with bounds A / M , and B/M. 

b) Moreover, the following statements are equivalent: 

(i) <P is a (tight) frame. 

(ii) /i* := M 7 — 7aYii=i ll<Pfll 2 <5 fi is a (tight) unit norm probabilistic frame. 

L, = i \\<Pi\\ ||<p,-|| 

(Hi) — jlEi a }8fi is a (tight) probabilistic frame. 

Proof. Clearly, ji& is a probability measure, and its support is the set {(Pk}¥ = i, such 
that, 

M 

(x,y) 2 dn<p(y) = ^ £ p*) 2 

k=\ 



[ 



Part a) can be easily derived from the above equality, and direct calculations imply 
the remaining equivalences. 
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Remark 2. Though the frame bounds of are smaller than those of <P, we observe 
that the ratios of the respective frame bounds remain the same. 

Example 1. Let dx denote the Lebesgue measure on M. N and assume that / is a posi- 
tive Lebesgue integrable function such that J r n f(x)dx — 1. If J r jv ||x|| 2 /(x)fix < °o, 
then the measure fi defined by dji(x) = f(x)dx is a (Borel) probability measure that 
is a probabilistic frame. Moreover, if f(x\ ,...,xn) = f{±x\ ±Xjv)> f° r a ^ com- 
binations of ±, then jj, is a tight probabilistic frame, cf. Proposition 3.13 in |[T4| . 
The latter is satisfied, for instance, if / is radially symmetric, i.e., there is a function 
gsuch fhat/(x) =g(||*||). 

Viewing frames in the probabilistic setting that we have been developing has 
several advantages. For instance, we can use measure theoretical tools to generate 
new probabilistic frames from old ones and, in fact, under some mild conditions, 
the convolution of probability measures leads to probabilistic frames. Recall that the 
convolution of jx , V £ 3? is the probability measure given by jj,*v(A) = J k n h(A — 
x)dv(x) for A £ 38. Before we state the result on convolution of probabilistic frames, 
we need a technical lemma that is related to the support of a probability measure that 
we consider later. The result is an analog of the fact that adding finitely many vectors 
to a frame does not change the frame nature, but affects only its bounds. In the case 
of probabilistic frames, the adjunction of a single point (or finitely many points) to 
its support does not destroy the frame property, but just changes the frame bounds: 

Lemma 1. Let \i be a Bessel probability measure with bound B>0. Given££ (0,1) 
set /x £ = (1 — e)/j. + eSq. Then [l £ is a Bessel measure with bound B £ = (1 — e)B. If 
in addition jX is a probabilistic frame with bounds < A < B < °°, then )l £ is also a 
probabilistic frame with bounds (1 — e)A and (1 — e)B. 

In particular, if jl is a tight probabilistic frame with bound A, then so is /X £ with 
bound (1 — e)A 

Proof. fi £ is clearly a probability measure since it is a convex combination of prob- 
ability measures. The proof of the lemma follows from the following equations 

[ \(x,y)\ 2 d^(y) = (l-£) / \(x,y)\ 2 dn(y) + e [ \(x,y)\ 2 dSo(y) 
Jr n Jr n Jr n 

= (l-e) [ \(x,y)\ 2 dii(y). 

We are now ready to understand the action of convolution on probabilistic frames. 

Theorem 2. Let jX £ &2 be a probabilistic frame and let v £ 3?%. 7/'supp(/i) con- 
tains at least N + 1 distinct vectors, then [l*V is a probabilistic frame. 

Proof. We shall use TheoremQ] 
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Mf(/i*v) = \\y\\ 2 dfi*v(y) 

Jm.n 

= ([ \\x+y\\ 2 d^{x)dv{y) 

JJr n xR n 

< M 2 {/i) +M 2 2 (v) +2M 2 (m)M 2 (v) 
= (M 2 (li)+M 2 (v)) 2 <°°. 

Thus, ji * v € SPi, and it only remains to verify that the support of ji * v spans Mr, 
cf. Theorem[T] Since supp(/i) must span R w , there are {(Pj}^^ C supp(/i) that 
form a frame for M. N . Due to their linear dependency, for each x € M. N , we can find 
{cj}^ 1 C R such that x = c ; -^ with 1^+' c ; = 0. For y e supp(v), we then 
obtain 

N+l N+l N+l 

x = x + 0y= c j u j + H c />' = H c ./'("/'+3') e span(supp(jtx) +supp(v)). 

7=1 7=1 j I 

Thus, supp(jLi) C span(supp(jii) + supp(v)). Since supp(/i) +supp(v) C supp(/i * 
v), we can conclude the proof. 

Remark 3. By Lemma[T]we can assume without loss of generality that € supp(v). 
In this case, if ju is a probabilistic frame such that supp(/i) does not contain N + 1 
distinct vectors, then jj. * v is still a probabilistic frame. Indeed, € supp(v), and 
En = M. N together with the fact that supp(/i) + supp(v) C supp(/x * v) imply that 
supp(/i * v) also spans M. N . 

Finally, if fi is a probabilistic frame such that supp(/i) does not contain N+l 
distinct vectors, then supp(ju) = {<Pj}^ = i forms a basis for M. N . In this case, ji * 
V is not a probabilistic frame if v = 8- x , where x is an affine linear combination 
of {<P;};=i- Indeed, x = I% =1 cj(pj with I% =1 cj = 1 implies L c;(?j vi = 
although not all cj can be zero. Therefore, supp(/x * v) = {(pj —x}j =l is linearly 
dependent and, hence, cannot span M. N . 

Proposition 2. Let /i and v be tight probabilistic frames. If v has zero mean, i.e., 
J]^Nydv(y) = 0, then [l*V is also a tight probabilistic frame. 

Proof. Let and A v denote the frame bounds of ji and v, respectively. 

/ |(x,y)| 2 ^*v(y)= f / \{x,y + z)\ 2 dpL{y)dv(z) 

Jr n Jr n Jr n 

= I \ I N \(x,y)\ 2 My)dv{z)+ f ( J(x,z)\ 2 dLi(y)dv(z) 

JrH JRN Jr(V J R N 

Jr n Jr n 

= A M ||x|| 2 +A v ||x|| 2 + 2( / U,y)xdn(y), [ zdv(z)) 
Jr n Jrn 

= (A M +A v )||x|| 2 , 
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where the latter equality is due to J MN zdv(z) = 0. 

Example 2. Let {(p/j-vij C M. N be a tight frame, and let v be a probability measure 
with dv(x) = g(\\x\\)dx for some function g. We have already mentioned in Ex- 
ample Q] that v is a tight probabilistic frame and Proposition [2] then implies that 
(}} l!iLi <>-(pi) * V = -g YJHi f( x - <Pi)dx is a tight probabilistic frame, see FigureQ] 
for a visualization. 



(a) The orthonormal basis is convolved with a gaussian 



oo \S l£> 



(b) The mercedes benz convolved with a gaussian 

Fig. 1 Heatmaps for the associated probabilistic tight frame, where {<p,}" = i C R 2 is convolved 
with a gaussian of increased variance (from left to right). The origin is at the center and the axes 
run from —2 to 2. Each colormap separately scales from zero to the respective density's maximum. 



Proposition 3. Let pL and V be two probabilistic frames on R^ 1 and M. Nl with lower 
and upper frame bounds A^,A V and B^,Z? V , respectively, such that at least one of 
them has zero mean. Then the product measure J ~ jX®V is a probabilistic frame 
for K^ 1 x R^ 2 with lower and upper frame bounds min(A|j,A v ) and max(B^,fi v )> 
respectively. 

If in addition, jj. and V are tight and M\ (/J. ) /N\ = M\ (v)/A?2, then y = ju ® V is 
a tight probabilistic frame. 

Proof. Let (zi,z 2 ) € R" 1 x R N i, then 
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II n n ((zuz2),(x,y)) 2 dY(x,y)= ff ({ Zl ,x) + {z2,y)) 2 dY(x,y) 

= // '„ n M 2 dy{x,y)+ ff (z 2 ,y) 2 dy(x,y) 

JjR N i xR N 2 JjR N l xR n 2 

+ 2 II n A z ^ x )^y) d y( x ^y) 

JJR N i xR N 2 

= f N (zi,x) 2 dn{x)+ f (z 2 ,y) 2 dv{y) 
Jr n i Jr n 2 

+ 2 J rNi J rN? (z\,x)(z2,y)dn{x)dv(y) 
= I N (zi,x) 2 dn(x)+ f (z2,y) 2 dv{y) 

JR N i JR N 2 

where the last equation follows from the fact one of the two probability measures 
has zero mean. Consequently, 

A,\\zi\\ 2 +A v \\z2\\ 2 < ff ((z h Z2),(x,y)) 2 d Y (x,y) <B^\\zi\\ 2 +B V \\ Z2 \\ 2 , 
JJr n i xR n 2 

and the first part of the proposition follows from ||(zi,Z2)|| 2 = \\z\ \\ 2 + \\z2\\ 2 - The 
above estimate and Theorem[TJimply the second part. 

When N\ = N2 = N in Proposition [3] and ji and v are tight probabilistic frames 
for R N such that at least one of them has zero mean, then 7 = jj, <g> v is a tight 
probabilistic frame for R N x Mr. It is obvious that the product measure y = \l ® V 
has marginals jj. and v, respectively, and hence is an element in F(ju,v), where 
this last set was defined in (O. One could ask whether there are any other tight 
probabilistic frames in r(ji, v), and if so, how to find them. 

The following question is known in frame theory as the Paulsen problem, cf. J5] 
UM\- given a frame {(Pj}f =l C M. N , how far is the closest tight frame whose elements 
have equal norm? The distance between two frames <P = {<P;}^i and f = {yi'}j=i 
is usually measured by means of the standard ^-distance Y.f=i ||<p,- — y/, || 2 . 

The Paulsen problem can be recast in the probabilistic setting we have been con- 
sidering, and this reformulation seems flexible enough to yield new insights into the 
problem. Given any nonzero vectors <t> = {<p,}^j, there are two natural embeddings 
into the space of probability measures, namely 

Y M j M 

^ = 77 and A^:= M ., p £ IMI 2 3ft/||ft||- 

m i=l Lj=i \\Yj\\ ;=i 

The 2-Wasserstein distance between ji<p and pLy satisfies 

M M 

^llM*-Wll%= inf Ell^-^(i)ll 2 <EH^-Wll 2 . ( 4 ) 
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where TIm denotes the set of all permutations of { 1 , . . . ,M}, cf. (231 ■ The right hand 
side of (0]i represents the standard distance between frames and is sensitive to the the 
ordering of the frame elements. However, the Wasserstein distance allows to rear- 
range elements. More importantly, the ^-distance requires both frames to have the 
same cardinalities. On the other hand, the Wasserstein metric enables us to deter- 
mine how far two frames of different cardinalities are from each other. Therefore, in 
trying to solve the Paulsen problem, one can seek the closest tight unit norm frame 
without requiring that it has the same cardinality. 

The second embedding ju* can be used to illustrate the above point. 

Example 3. If, for £ > 0, 

<P e = {(1,0) T , y|(sin(e),cos(e)) T , yi(sin(-£),cos(-e)) T }, 

then jU* E — > 5(5,,] + 8 e2 ) in the 2-Wasserstein metric as e — > 0, where {e,}? =1 is the 
canonical orthonormal basis for R 2 . Thus, {<?;} 2 =1 is close to <P £ in the probabilistic 
setting. Since {<?,}? =1 has only 2 vectors, it is not even under consideration when 
looking for any tight frame that is close to <P e in the standard ^-distance. 

We finish this subsection with a list of open problems whose solution can shed 
new light on frame theory. The first three questions are related to the Paulsen prob- 
lem, cf. ||2|2]E), that we have already mentioned above: 

Problem 1. (a) Given a probabilistic frame G &>{S"~ ), how far is the clos- 
est probabilistic tight unit norm frame v G ^(S N ^ 1 ) with respect to the 2- 
Wasserstein metric and how can we find it? Notice that in this case, 3 g 2(S N ~ l ) = 
^(S N ^ 1 ) is a compact set, see, e.g., 11271 Theorem 6.4]. 

(b) Given a unit norm probabilistic frame jU G ^z> now far is tne closest probabilis- 
tic tight unit norm frame v G 3^2 with respect to the 2- Wasserstein metric and 
how can we find it? 

(c) Replace the 2-Wasserstein metric in the above two problems with different 
Wasserstein ^-metrics Wp(jJ,,v) — infy er ^ v j J k n xM n \\x — y\\ p dy{x,y), where 

(d) Let ;U and v be two probabilistic tight frames on M. N , such that at least one of 
them has zero mean. Recall that F(ju,v) is the set of all probability measures 
on M. N x M. N whose marginals are fi and v, respectively. Is the minimizer 70 G 
r(/i,v) for W 2 2 (ju,v) a probabilistic tight frame? Alternatively, are there any 
other probabilistic tight frames in F(/i, v) besides the product measure? 



2.2 The probabilistic frame and the Gram operators 

To better understand the notion of probabilistic frames, we consider some related 
operators that encode all the properties of the measure jj,. Let fi G @* be a proba- 
bilistic frame. The probabilistic analysis operator is given by 
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r M :M w ->L 2 (M. N ,n), x i-><x,-}. 
Its adjoint operator is defined by 

T* : L z (R N ,n) -> R* />->•/ f{x)xdn(x) 
^ Jr n 

and is called the probabilistic synthesis operator, where the above integral is vector- 
valued. The probabilistic Gram operator, also called the probabilistic Grammian of 
il, is Gfi = T^T*. The probabilistic frame operator of /I is 5^ = T^T^, and one 
easily verifies that 

5 M : R N -> M N , 5^ (x) = / y(*,y)^(y). 

VR" 

If is the canonical orthonormal basis for R , then the vector valued integral 

yields 

/ v ( 'Ww = I f N y [C) y U) dii{y)<Pj, 

Jr n s Jr'v 

where y = (yW, . . . jy^) 1 " € R^. If we denote the second moments of /I by /«,,;(/! ), 
i.e., 

m !'/'(j u )=/ x^x^dflfx), for;',;' = l,...,N, 

Jr n 

then we obtain 

SmW = / J ( 'WW = I / y (,) y (7 'WM<P./ = L«y(M)fl>/- 

Thus, the probabilistic frame operator is the matrix of second moments. 
The Grammian of Li is the kernel operator defined on L 2 (R , jtt) by 

G M /(x) - r M 2£/(x) = / K(x,y)f(y)dLi(y) = [ (x,y)f(y)dLi(y). 
r Jr n Jr n 

It is trivially seen that G is a compact operator on L 2 (R N and in fact it is 
trace class and Hilbert-Schmidt. Indeed, its kernel is symmetric, continuous, and 
in L 2 (R N x R n ,li c L 1 (R w xR # ,fJ8 /i). Moreover, for any / e L 2 (R N ,fl), 
Gfxf is a uniformly continuous function on R . 
Let us collect some properties of and G^: 

Proposition 4. If jj, £ £P ', then the following points hold: 

a) Sp, is well-defined (and hence bounded) if and only if 

M 2 (jU) < oo. 

b) jX is a probabilistic frame if and only ifS^ is well-defined and positive definite. 

c) The nullspace ofG^ consists of all functions in L 2 (R N ,Ll) such that 



Probabilistic frames: An overview 1 1 

r yf(y)dn(y)=0. 

Moreover, the eigenvalue of has infinite multiplicity, that is, its eigenspace is 
infinite dimensional. 

For the sake of completeness, we give a detailed proof of Proposition^ 

Proof. Part a): If 5^ is well-defined, then it is bounded as a linear operator on a 
finite dimensional Hilbert space. If \\S^\\ denote its operator norm and {ej}f =l is an 
orthonormal basis for R , then 

/jbll>(y) = I f (e,,y)(y,e l )d^y) = t(S,(ei),e i )<t\\S,(ed\\<N\\S,l 

JR i=l JR N j=l ,- =1 

On the other hand, if M 2 (/i) < °°, then 

\(x,y)\ 2 dfi(y) < / ||x|| 2 ||y|| 2 ^(>') = IW| 2 M 2 2 (m), 



and, therefore, 7^ is well-defined and bounded. So is T* and hence is well- 
defined and bounded. 

Part b): If jj, is a probabilistic frame, then M2(/i) < °°, cf. Theorem[T] and hence 
is well-defined. If A > is the lower frame bound of fi, then we obtain 



2 , for all x G R^, 



(x,S ll (x)) = [ {x,y)(x,y)d-n(y)= [ \(x,y)\ 2 d^(y) >A\\x\\ 
Jr n Jr n 

so that is positive definite. 

Now, let be well-defined and positive definite. According to part a), M 2 (jj.) < 
oo so that the upper frame bound exists. Since is positive definite, its eigenvectors 
{viKLj ar e a basis for M. N and the eigenvalues {A,-}^ =1 , respectively, are all positive. 
Each x € M. N can be expanded as x = Yd=i a ' v > sucn tnat L;=i a j = \\ x \\ 2 - If A > 
denotes the smallest eigenvalue, then we obtain 



\{x,y)\ 2 djl{j) = (x,S^(x)) = £fli(vi, Ayflyvy) = £fl 2 A, > A ||x 



so that A is the lower frame bound. 

For part c) notice that / is in the nullspace of if and only if 



= 



/ (x,y)fb>W(y) = (x, / yf(y)dfi{y)), for each x£ 

Jr n Jr n 



The above condition is equivalent to f RN y f(y)d/x (y) = 0. The fact that the eigenspace 
corresponding to the eigenvalue has infinite dimension follows from general prin- 
ciples about compact operators. 

A key property of probabilistic frames is that they give rise to a reconstruction 
formula similar to the one used in frame theory. Indeed, if pi <G ^ is a probabilistic 
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frame, set fi = jj, o Sp, 



and we obtain 



x = [ {x,y)S pL ydfi{y) = f y(S^y,x)dfi(y), for all x£M. N . (5) 




This follows from = S^S^ = Id. In fact, if /l is a probabilistic frame for 

M. N , then jl is a probabilistic frame for K . Note that if jj, is the counting measure 
corresponding to a finite unit norm tight frame {(Pi)fL { , then p, is the counting mea- 
sure associated to the canonical dual frame of (<p,)^j, and Equation © reduces to 
the known reconstruction formula for finite frames. These observations motivate the 
following definition: 

Definition 2. If jj. is a probabilistic frame, then jx= fioS^ is called the probabilistic 
canonical dual frame of /X. 

Many properties of finite frames can be carried over. For instance, we can follow 
the lines in [[T0| to derive a generalization of the canonical tight frame: 

Proposition 5. If jj, is a probabilistic frame for M. N , then jl o S l J 2 is a tight proba- 
bilistic frame for M. N . 

Remark 4. The notion of probabilistic frames that we developed thus far in finite 
dimensional Euclidean spaces can be defined on any infinite dimensional separable 
real Hilbert space X with norm || • \\x and inner product (-,-)x- We call a Borel 
probability measure ftonXa probabilistic frame for X if there exist < A < B < °° 
such that 



If A = B, then we call pi a probabilistic tight frame and we will present a complete 
theory of these probabilistic frames in a forthcoming paper. 

3 Probabilistic frame potential 

The frame potential was defined in |4 14 28 32i|. and we introduce the probabilistic 
analog: 

Definition 3. For jl £ 3^2, the probabilistic frame potential is 



Note that PFP(jLi) is well defined for each fx e ^ 2 and PFP(ju) < M%(fl). 

In fact, the probabilistic frame potential is just the Hilbert-Schmidt norm of the 
operator , that is 




for all x G X. 




(6) 



\\Gh\\hs= II n (x,y) 2 dii{x)d»(y) = Y J Xl 
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where A* := Afc(jLi) is the k-th eigenvalue of G M . If <P = {q>i}f =l M > N is a finite 
unit norm tight frame, and jj, = j}Yd=i is tne corresponding probabilistic tight 
frame, then 

M 

According to Theorem 4.2 in JT4), we have 

PFP(M) > ^(m), 

and, except for the measure 80, equality holds if and only if jj. is a probabilistic tight 
frame. 

Theorem 3.1fpe such thatM 2 (lJ.) = 1, then 

PFP(/i) > 1/n, (7) 

where n is the number of nonzero eigenvalues ofS^. Moreover, equality holds if and 
only if H is a probabilistic tight frame for E^. 

Note that we must identify with the real dim (E^) -dimensional Euclidean space 
in Theorem [3] to speak about probabilistic frames for E^. Moreover, Theorem [3] 
yields that if jx € 3^2 such thatM2(jU) = 1, then PFP(jU) > \/N, and equality holds 
if and only if jU is a probabilistic tight frame for Mr, 

Proof. Recall that Ct(G^) = criS^) U {0}, where o(T) denotes the spectrum of the 
operator T. Moreover, because is compact its spectrum consists only of eigen- 
values. Moreover, the condition on the support of /i implies that the eigenvalues 
{^■k}k=i °f are a U positive. Since 

cr(G M ) = a(5 M )U{0} = {^}t 1 u{0}, 

the proposition reduces to minimizing Jx=i %i under the constraint L^ =1 = 1> 
which concludes the proof. 



4 Relations to other fields 



Probabilistic frames, isotropic measures, and the geometry of convex bodies 

A finite nonnegative Borel measure fx on S N ~^ is called isotropic in lfT7ll24l if 

/ |( r ,,)|2 </M(y) = M(Q y xG s N -\ 

Jsn- 1 N 

Thus, every tight probabilistic frame jj. £ £?(S N ~ X ') is an isotropic measure. The 
term isotropic is also used for special subsets in Mr. Recall that a subset K C R. N is 
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called a convex body if K is compact, convex, and has nonempty interior. According 
to |26l Section 1.6] and ifTTl , a convex body K with centroid at the origin and unit 
volume, i.e., f K xdx = and voIn(K) — J K dx = 1, is said to be in isotropic position 
if there exists a constant Lk such that 



\(x,y)\ 2 dy = L K VxeS N - 1 . (8) 

K 



Thus, K is in isotropic position if and only if the uniform probability measure on 
K, denoted by gr, is a tight probabilistic frame. The constant must then satisfy 
l k = 7^ J K \\ x \\ 2 do K {x). 

In fact, the two concepts, isotropic measures and being in isotropic position, can 
be combined within probabilistic frames as follows: given any tight probabilistic 
frame ji G & on R , let Kn denote the convex hull of supp(/i). Then for each 
x S S N we have 

\(x,y)\ 2 dn(y)= [ , \(x,y)\ 2 dii(y)= [ \(x,y)\ 2 dii(y) 

Though, Kn might not be a convex body, we see that the convex hull of the support 
of every tight probabilistic frame is in "isotropic position" with respect to /i. 

In the following, let € ,^(S N ^ 1 ) be a probabilistic unit norm tight frame with 
zero mean. In this case, is a convex body and 

! N+ l)(N+l)/2 

voW(^)>^— ^ N I , 

where equality holds if and only if is a regular simplex, cf. [3] 124). Note that 
the extremal points of the regular simplex form an equiangular tight frame { (p;}^ 1 , 
i.e., a tight frame whose pairwise inner products \ (q)j, (pj) | do not depend on ; ^ j. 
Moreover, the polar body := {x € M. N : (x,y) < 1, for all y € supp(/i)} satisfies 



(Ar+i) (jv+l)/ y /2; 



voW^) < 

and, again, equality holds if and only if is a regular simplex, cf. 

Probabilistic tight frames are also related to inscribed ellipsoids of convex bodies. 
Note that each convex body contains a unique ellipsoid of maximal volume, called 
John's ellipsoid, cf. 1181 . Therefore, there is an affine transformation Z such that 
the ellipsoid of maximal volume of Z(K) is the unit ball. A characterization of such 
transformed convex bodies was derived in fl8l . see also 0: 

Theorem 4. The unit ball B C M. N is the ellipsoid of maximal volume in the convex 
body K if and only if B C K and, for some M > N, there are {(Pi}fL l C S N ~ 1 H dK 
and positive numbers {cf\f = \ such that 

(a) Y!iL\ Cj(pi = and 

(b) Zf = i*<Pi<P7 =/v- 
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Note that the conditions (a) and (b) in Theorem |4] are equivalent to saying that 
jf YM= i c i$<Pi G & (S N ~ 1 ) is a probabilistic unit norm tight frame with zero mean. 

Last but not least, we comment on a deep open problem in convex analysis: Bour- 
gain raised in |6j the following question: Is there a universal constant c > such 
that for any dimension N and any convex body K in M. N with \oIn(K) = 1, there 
exists a hyperplane H C M. N for which voL/_ i (K n H) > cl The positive answer 
to this question has become known as the hyperplane conjecture. By applying re- 
sults in J26), we can rephrase this conjecture by means of probabilistic tight frames: 
There is a universal constant C such that for any convex body K, on which the 
uniform probability measure Ok forms a probabilistic tight frame, the probabilistic 
tight frame bound is less than C. Due to TheoremQ] the boundedness condition is 
equivalent to M| (ok) < CN. The hyperplane conjecture is still open, but there are 
large classes of convex bodies, for instance, gaussian random poly topes ||22| . for 
which an affirmative answer has been established. 

Probabilistic frames and positive operator valued measures 

Let Q be a locally compact Hausdorff space, 38{£1) be the Borel-sigma algebra on 
£2, and H be a real separable Hilbert space with norm || ■ || and inner product (■,•). 
We denote by J£(H) the space of bounded linear operators on H. 

Definition 4. A positive operator valued measure (POVM) on Q with values in 
^{H) is a map F : 38 (Q) -> _£f(#) such that: 

(i) F(A) is positive semi-definite for each A € 3§(Q); 

(ii) F(Q) is the identity map on H; 

(ii) If {A,}^ / is a countable family of pairwise disjoint Borel sets in 3§(Q), then 

F(U,-e/A;) = ^F(Ai), 
iei 

where the series on the right-hand side converges in the weak topology of (//), 
i.e., for all vectors x,y G H, the series ^ (G/ (F(A,)jc,y)converges. We refer to 0] 
[TOCG) for more details on POVMs. 

In fact, every probabilistic tight frame on M. N gives rise to a POVM on M. N with 
values in the set of real N xN matrices: 

Proposition 6. Assume that ji e ^(B^) is a probabilistic tight frame. Define the 
operator F from S3 to the set of real N x N matrices by 

^( A ) : =sfe(/w^(y)) ;/ (9) 

Then F is a POVM. 

Proof. Note that for each Borel measurable set A, the matrix F(A) is positive semi- 
definite, and we also have F(M. N ) = 1^. Finally, for a countable family of pairwise 
disjoint Borel measurable sets {A,}, e /, we clearly have for each x € M. N , 
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F(U ieI A i )x = Y,F{A k )x. 
kei 

Thus, any probabilistic tight frame in M. N gives rise to a POVM. 

We have not been able to prove or disprove whether the converse of this propo- 
sition holds: 

Problem 2. Given a POVM F : S§(M N ) 3?(R N ), is there a tight probabilistic 
frame ji such that F and ji are related through ©? 



Probabilistic frames and f-designs 

Let a denote the uniform probability measure on S N ~ 1 . A spherical t-design is a 
finite subset {(PijfL^ C S N ~ l , such that, 

1 " f 
-£>(>,■)= /„ h(x)da(x), 

for all homogeneous polynomials h of total degree less than or equal to t in N vari- 
ables, cf. |[T3l . A probability measure /x G iP(S N ~ l ) is called a probabilistic spher- 
ical t-design in 1 14] if 

f h(x)da(x) = I h(x)da(x), (10) 
Js N ~ 1 Js N - [ 

for all homogeneous polynomials h with total degree less than or equal to t. The 
following result has been established in lfl4l : 

Theorem 5. If ji G &(S N ~ l ), then the following are equivalent: 

( i) jLt is a probabilistic spherical 2-design. 

( ii) jJ. minimizes 

f S d- 1 J S d- 1 \(x,y)\ 2 d^i {x)dji (y) 
/jrf-l Jyf-l ||*-;y|| 2 ^(x)fl^i(;y) 

among all probability measures ^(S^ -1 ). 
(n'/J/i is fl tight probabilistic unit norm frame with zero mean. 

In particular, if jX is a tight probabilistic unit norm frame, then v(A) := ^(jl(A) + 
jl(—A)), for A G defines a probabilistic spherical 2-design. 

Note that j, CiS^ G ^ g (S N ^ 1 ) derived from conditions (a) and (b) in Theorem 
|4]on the John ellipsoid is a probabilistic spherical 2-design. 

Probabilistic frames and directional statistics 

Common tests in directional statistics focus on whether or not a sample on the unit 
sphere S N ~ l is uniformly distributed. The Bingham test rejects the hypothesis of 
directional uniformity of a sample {9i}fij C S N ~ l if the scatter matrix 
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j M 

is far from j/In, cf. l25l . Note that this scatter matrix is the scaled frame operator of 
{<Pi'}f=i an d, hence, one measures the sample's deviation from being a tight frame. 
Probability measures ji that satisfy = jjl^ are called Bingham-alternatives in 
fl31 . and the probabilistic unit norm tight frames on the sphere S N ~ l are the Bing- 
ham alternatives. 

Tight frames also occur in relation to M-estimators as discussed in fl9i l29l [30l : 
The family of angular central Gaussian distributions are given by densities fr with 
respect to the uniform surface measure on the sphere S N ~ 1 , where 

fr{x) = det(r) " V2 (^ T r- 1 x)- JV / 2 1 forx G S"-\ 

CIn 

Note that F is only determined up to a scaling factor. According to 1301 . the max- 
imum likelihood estimate of F based on a random sample C S^ -1 is the 
solution F to 

= M " guy? 

which can be found, under mild assumptions, through the iterative scheme 
r N y <?i<?7 

l k+\ M 1 L ,„T 



where F> = / w , and then F — > F as — > °o. It is not hard to see that {V;}/=i := 

{ ||f-i/2y'|| }j=i C 5' A ' _1 forms a tight frame. If F is close to the identity matrix, then 

{yi}f=i i s close to {<Pi]f =i and it is likely that fr represents a probability measure 
that is close to being tight, in fact, close to the uniform surface measure. 

Probabilistic frames and compressed sensing 

For a point cloud {<Pz}jHi, the frame operator is a scaled version of the sample 
covariance matrix up to subtracting the mean and can be related to the popula- 
tion co variance when chosen at random. To properly formulate a result in (14*1 . let 
us recall some notation. For ji £ &>2, we define E(Z) := [ r n Z(x)dn(x), where 
Z : M. N — > K pXl7 is a random matrix/vector that is distributed according to ji. The 
following was proven in 04): 

Theorem 6. Let {-XjfclJL] be a collection of random vectors, independently dis- 
tributed according to probabilistic tight frames {fJ.k}f=i C respectively, whose 
4-th moments are finite, i.e., Af^/X^) := J k n \\y\\^dfXk(y) < °°. If F denotes the ran- 
dom matrix associated to the analysis operator o/{-Xjt}fLi> then we have 

E(\\—F*F-^-I N \\ 2 ») = —(L 4-—), (12) 
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where L, := ^lf =1 M 2 ( J u,), L 2 := ^f = l M l^k\ and L 4 = ^lf =1 M 4 4 ( W ). 



Under the notation of Theorem[6] the special case of probabilistic unit norm tight 
frames was also addressed in lfT4l : 

Corollary 1. Let {X/ ( }% , =1 be a collection of random vectors, independently dis- 
tributed according to probabilistic unit norm tight frames {H-k}k=l> respectively, 
such that M^jlk) < °°. If F denotes the random matrix associated to the analysis 
operator of {X/ ( }^ =i , then 



Randomness is used in compressed sensing to design suitable measurements ma- 
trices. Each row of such random matrices is a random vector whose construction is 
commonly based on Bernoulli, Gaussian, and sub-Gaussian distributions. We shall 
explain that these random vectors are induced by probabilistic tight frames, and in 
fact, we can apply Theorem[T] 

Example 4. Let {Xk\f =i be a collection of A^-dimensional random vectors such that 
each vector's entries are independently identically distributed (i.i.d) according to a 
probability measure with zero mean and finite 4-th moments. This implies that each 
Xk is distributed with respect to a probabilistic tight frame whose 4-th moments 
exist. Thus, the assumptions in Theorem [6] are satisfied, and we can compute ( TT~2T > 
for some specific distributions that are related to compressed sensing: 

• If the entries of X^, k = 1, . . . ,M, are i.i.d. according to a Bernoulli distribution 
that takes the values with probability 5, then X k is distributed according to 
a normalized counting measure supported on the vertices of the cZ-dimensional 
hypercube. Thus, X^ is distributed according to a probabilistic unit norm tight 
frame for R . 

• If the entries of X^, k = 1, . . . ,M, are i.i.d. according to a Gaussian distribution 
with mean and variance -i, then X^ is distributed according to a multivariate 

Gaussian probability measure fi whose covariance matrix is ^7^, and fi forms a 
probabilistic tight frame for Mr. Since the moments of a multivariate Gaussian 
random vector are well-known, we can explicitly compute L4 = 1 + j|, L\ = 1, 
and L2 = 1 in Theorem|6] Thus, the right-hand side of (fT2l) equals i(l + 4). 
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